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Abstract. Image features detection and description is a longstanding 
topic in computer vision and pattern recognition areas. The Scale In¬ 
variant Eeature Transform (SIET) is probably the most popular and 
widely demanded feature descriptor which facilitates a variety of com¬ 
puter vision applications such as image registration, object tracking, 
image forgery detection, and 3D surface reconstruction. This work in¬ 
troduces a Software as a Service (SaaS) based implementation of the 
SIET algorithm which is freely available at http://siftservice.com for 
any academic, educational and research purposes. The service provides 
application-to-application interaction and aims Rapid Application Devel¬ 
opment (RAD) and also fast prototyping for computer vision students 
and researchers all around the world. An Internet connection is all they 
need! 
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1 Introduction 

The Scale Invariant Feature Transform (SIFT) [1] has been the topic of many 
computer vision projects due to its ability to detect feature points which are 
invariant to image rotation, translation, and scaling. This is obviously evident 
from Figure 1 which presents the journal and conference papers related to the 
SIFT algorithm which have been published in Elsevier from 2009 to 2014. While 
several scientists have entered the development of SIFT based algorithm m, a, 
0,16], providing a service-based SIFT algorithm over the Internet protocols has 
not yet been developed. Having a Software as a Service (SaaS) based [7], [TT] 
SIFT algorithm can be fulfilled the following objectives: 

• To facilitate Rapid Application Development (RAD) and fast prototyping 
for computer vision students and scientists by a tiny service available on the 
Internet. 

• To provide application-to-application interaction for a highly demanded com¬ 
puter vision algorithm. 

• To make the SIFT algorithm available through both human-oriented and 
application-oriented interfaces. 


Fig. 1. Number of Elsevier publications over last six years. Results achieved 
by submitting the query ”SIFT algorithm” from Elsevier website at 
htt p: / / WWW. sciencedirect. com 
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In this contribution, we novel design and develop a SaaS based architecture 
to implement a platform independent and reusable software component for the 
SIFT algorithm. The service makes a new way to produce and exchange of 
SIFT information over the standard Internet protocols. Based on its flexibility 
and availability, it brings an opportunity for computer vision researchers who 
want to apply the SIFT algorithm on their own images without the need of any 
programming and installing any software applications. An Internet connection 
is all we need! 

This work initiates a study of SaaS based architecture for an essential com¬ 
puter vision technique. We expect the work can bridge the gap between computer 
vision applications and World Wide Web services, stimulating more interests 
from the computer vision community to the SaaS architecture and the Internet 
of Things (loT) areas. Our contribution could be considered as a preliminary 
step towards the Computer Vision as a Service. 

The rest of the paper is arranged as follows. We first give a brief explanation 
of the system and service design in Section 2. The experimental results along 
with an application of the SIFT algorithm and the impact of the service are 
shown in Section 3. Conclusion is presented in Section 4. 

2 System and Service Design 

SIFT algorithm has basically four main stages, namely: 1) Scale-space construc¬ 
tion using Difference-of-Gaussian (DoG), 2) Stable features localization, 3) Gra¬ 
dient orientation computation and magnitude assignment, and 4) Feature de¬ 
scriptors extraction [1]. The first stage is to construct a DoG image pyramid 
to determine the potential feature points in an image. As it is shown in equa¬ 
tion (1), to create Gaussian filtered image, we should convolve the input image 
I{x^y) with a Gaussian kernel K{x^y;a) (equation (2)), where a is the scale of 







the Gaussian kernel, and conv2 is 2D convolution operation. Various Gaussian 
blurred images in different scales are produced and DoGs are computed from 
neighbors in the scale space. Then candidate feature points would be detected 
by discovering exterma in the DoG images which are locally minima or maxima 
in scale and space. 


G(x, y; a) = conv2{I{x, y),K{x, y, a)) (1) 

K{x,y\a) = (2) 

The next step is to compute the image gradient magnitude and principal 
orientation to extract associate SIFT descriptor for the a detected feature point. 
Gradient magnitude as m(x, y) and principal orientation as y) are calculated 
using the following two equations: 


0{x,y)=ta.n ^{{G{x,y + 1) - G{x,y - l))/{G{x + l,y) - G{x - l,y))) (3) 

m{x, y) = y {G{x, y + 1) - G{x, y - 1))2 + {G{x + 1, y) - G(x - 1, y)Y (4) 

Finally, for each feature point, a set of orientation histograms will be created 
on 4 X 4 pixel neighborhoods with eight bins each. The size of the descriptor 
vector can be varied. The high level service architecture of the siftservice.com is 
shown in Figure 2. 


The service compromises two disparate machines: a service consumer (Client) 
and the service provider (Application Server) [12]. Main components of each 
section are presented within the subsystem blocks (Figure 2). WSDL stands 
for Web Service Description Language, and it is an XML-based language for 
describing SIFT web service and how to access it over the Internet protocols. 
Discovery Services permit the discovery of the SIFT service. BPELWS stands 
for Business Process Execution Language for Web Service, and it aims to sup¬ 
port the major behaviors of both executable and abstract implementation of the 
service. SOAP stands for Simple Object Access Protocol [8|, [10]. SOAP is an 
XML-based Internet protocol which supports exchanging structured information 
between computers and applications. UDDI which stands for Universal Descrip¬ 
tion, Discovery and Integration is a specification for a distributed registry of the 
SIET service [I], [8], [10], [TT]. An snapshot of siftservice.com is shown in Eigure 
3. 

3 Experimental Results 

In order to examine the general performance of the system, two experiments were 
carried out on real digital images. Section 3.1 shows the experimental setup. In 
Section 3.2, we compare the feature points detection accuracy of the system with 
the original executable SIET software implemented by David Lowe [2] . In Section 




Fig. 2. siftservice.com: The service architecture. 
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3.3, we analyze and compare matching accuracy between SIFT keypoints in two 
images using the SIFT as a Service and the original executable SIFT software 
[2]. We then introduce an application of the SIFT algorithm in Section 3.4. The 
impact of the siftservice.com is presented in Section 3.5. 


3.1 Experimental Setup 

All modules, classes, components, and communication packages of siftservice.com 
were implemented by Java SE 7. In the server side (Application Server), we used 
a 64-bit Linux CentOS operating system on a virtual server with 2v cores pro¬ 
cessor, 100 Mbits/s bandwidth, and 2GB of RAM. In the client side (Client), 
we employed 64-bit MS Windows 8 operating system with 3.00 GHz Intel Dual 
core CPU, 2MB cache, and 4GB of RAM. 


3.2 Accuracy in Feature Points Detection 

In this section we bring up a validation summary on the accuracy and reliability 
of the proposed system for feature points detection. Figure 4 shows the accuracy 
in feature points detection. The service produces feature points which are very 
similar to the original one implemented by Lowe. The error threshold of the 
SIFT as a Service is less than 1% in feature points detection. 
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Fig. 3. siftservice.com: An snapshot. 
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SIFT as a Service 

The Scale-Invariant Feature Transform (SIFT) algorithm has 
shown an amazing success in almost every computer vision 
applications including object recognition, panorama 
stitching, image forgery detection, object tracking, robot 
navigation, and 3D sur^e reconstruction. SIFT as a 
Service is a reusable, platform independent, and extensible 
software component which represents a new way to produce 
and exchange of the highly demanded SIF information over 
the standard Internet protocols. Based on its flexibility and 
availability, it brings an opportunity for various researchers 
who want to apply the SIF algorithm on their own images 
without the need of any programming and installing any 
software applications. The service provides application- 
to-application interaction and makes the SIF algorithm 
available from any computers or smart phones, any time, 
anywhere. An Internet connection is all you need! SIF as a 
Service is designed and developed by Biomedical Modeling 
and Visualization Laboratory in Computer Science 
Department at University of Wisconsin Milwaukee, USA. 


How to use SIFT as a Service 


TT decision-makers accept SaaS as the future of software.' 
-Computer Weekly 





Fig. 4. Accuracy in Feature Points Detection. (A) Results obtained by the original 
executable SIFT software implemented by David Lowe (number of feature: 1638). (B) 
Results obtained by the SIFT as a Service (number of feature: 1627). Image Set: EMS 
Building. 
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3.3 Accuracy in Points Matching 


Figure 5 shows the points matching accuracy for images ’’hallOl” and ”hall02” 
form the ’’Hall” images set. We can see that the error threshold for point match¬ 
ing is less than 2% comparing with the David Lowe’s implementation. 


Fig. 5. Accuracy in points matching. (A) Results obtained by the original executable 
SIFT software implemented by David Lowe (number of matches: 166). (B) Results 
obtained by the SIFT as a Service (number of matches: 158). Image Set: Hall. 
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3.4 An Application: 3D Microscopy Vision 

As we mentioned in the abstract, The SIFT algorithm has made in big advance 
in many areas of computer vision application. An example is 3D surface recon¬ 
struction, and in particular 3D microscopy vision. The general pipeline of 3D 
microscopy vision is presented in Figure 6. The SIFT algorithm is used in step 
2 of the pipeline. For further details and information on the proposed method, 
please refer to [9]. We just recall that in that work [9], we employed SURF m 
instead of SIFT, but other parts would be same. 


3.5 siftservice.com Imapct 

siftservice.com has been introduced and it is going to be popular for computer 
vision research community. Figure 7 present the impact of siftservice.com from 
December 2014 to March 2015. 




















(2) Extract feature points for each image in the set. 



(3) Match the feature points. 


(4) Estimate rotation and translation using epipolar geometry. 

(5) Initialize 3D points using linear triangulation. 

(6) Make the final 3D shape model using a refinement process. 



Fig. 7. siftservice.com impact. Number of users from December 2014 to March 2015. 
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4 Conclusion 


The SIFT algorithm has been widely used in many computer vision applications. 
Having SIFT as a Service would provide application-to-application interaction 
and makes SIFT easier for computer vision researchers and students to Rapid 
Application Development (RAD), communicating each other applications by a 
tiny service available in the Internet. In this project, we have designed and imple¬ 
mented the entire components of the system and addressed some experimental 
results which show that the service offers promising results. The present work 
is expected to stimulate more interest and draw attentions from the computer 
vision community to the fast-growing Software as a Service and the Internet of 
Things (loT) area. Our contribution could be considered as a preliminary step 
towards the Computer Vision as a Service. The service is freely available at 
http://siftservice.com for any academic, educational and research purposes. 
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